Diversity-induced resonance 
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We present conclusive evidence showing that different sources of diversity, such as those repre- 
sented by quenched disorder or noise, can induce a resonant collective behavior in an ensemble of 
coupled bistable or excitable systems. Our analytical and numerical results show that when such 
systems are subjected to an external subthreshold signal, their response is optimized for an interme- 
diate value of the diversity. These findings show that intrinsic diversity might have a constructive 
role and suggest that natural systems might profit from their diversity in order to optimize the 
response to an external stimulus. 



Noise induced, or stochastic, resonance emerged in the 
early eighties as a proposal to explain the periodicity ob- 
served in the Earth ice ages [l|,|2j. The mechanism is such 
that an external forcing acting upon a nonlinear system 
can be conveniently amplified under the presence of the 
right amount of noise. This innovative proposal led many 
researchers to look for a similar constructive role of noise 
in physical, chemical, biological, and many other kinds of 
systems 0, 0, IE El • While initially the studies focused on 
simple, low-dimension, dynamical systems, more recent 
work Q, has considered the constructive role of noise 
in extended systems composed of many coupled identi- 
cal units. The assumption of identical units, while being 
mathematically convenient, is not very realistic for many 
of the applications since it is clear that in some natu- 
ral systems, specially in biology, the units composing the 
ensemble present a disparity in the values of some char- 
acteristic parameters. Among other consequences, this 
natural diversity makes each isolated system respond dif- 
ferently to an external forcing; it is an open question to 
investigate the effect that diversity has on the global re- 
sponse of the collective system. 

This problem has received some recent attention. For 
instance, Hong [t| analyzes the locking behavior of an 
ensemble of coupled oscillators with different internal fre- 
quencies subject to a periodic external forcing. He finds 
that the quenched disorder helps a small fraction of the 
oscillators to lock to the external frequency. However, he 
does not observe a collective behavior in which the whole 
ensemble benefits form the diversity in the internal fre- 
quencies. In this Letter we give evidence that the right 
amount of diversity, in the form of quenched noise, might 
help an extended system to respond globally in a more 
coherent way to an external stimulus. 

As in the case of stochastic resonance, we believe that 
the results reported here are very general. For the sake 
of concreteness, however, we have considered two proto- 
typical nonlinear systems: one bistable and another ex- 
citable. In both cases, we show that there is a resonance 
effect in the global response as a function of the diversity. 

We consider first an ensemble of N globally coupled 



bistable systems, whose dynamics is given by 

C N 

Xi = Xi ~ + a,i + — ( X J - x % ) + A sin(fit). (1) 

i=i 

Here Xi(t), i = 1, . . . , N is the position of the i-th unit at 
time t and C is the coupling strength. The location and 
relative stability of the fixed points of the dynamics of 
an isolated unit i are modified by the parameter ai. We 
assume the a^'s to take independent values distributed 
according to a probability distribution function g(a) that 
satisfies (a) = 0, (dj ctj) — Sija 2 . a will be referred to as 
the diversity. The system is also subjected to an external 
periodic forcing, of intensity A and frequency = 2n/T. 
For simplicity, and to emphasize the role of the diversity, 
we neglect standard noise effects on those equations. 

In order to quantify the response of the system to the 
external forcing, we introduce the average position of the 
units X{t) — jj YliLi x i(t)- I n the globally coupled case 
considered here, the coupling amongst units appears only 
through this macroscopic quantity: 

x l = CX + (l- C)xi -xf + at + A sin(fit). (2) 

This can be put in a potential form Xi = — with a 
suitable time dependent potential Vi(xi\ t, a^, X) whose 
explicit expression can be easily obtained. By averaging 
eq.(|5| over the whole population, we obtain 

A = X-1 J> 3 + ,4sin(fU). (3) 

i 

Here and henceforth averages with respect to the vari- 
ables cii are replaced with averages with respect to the 
distribution g(a). Following reference 0], ^ us intro- 
duce 5i, such that Xi — X + 5i. We additionally intro- 
duce J2i S i = M - Notice that M > 0. Under the 
assumption of 5i being distributed according to an even 
distribution prT| we get, using eq. ©, 

X = X(l-3M)-X 3 + Asin(nt). (4) 

The unforced system is bistable with equilibrium points 
at X± — ±\/l — 3M. For a = 0, M vanishes after an 
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initial transient to wash out the effect of the possibly dif- 
ferent initial conditions for the x^s. A weak, subthresh- 
old, forcing (namely A < 0.3 for the range of frequencies 
used in this work), will not suffice to have the global vari- 
able X jump from one stable point to the other as it will 
simply make small oscillations around one of the equi- 
librium points. As the diversity increases, M increases 
with a twofold effect: first, the stable points approach 
each other and, second, the height of the barrier separat- 
ing them decreases. It might be possible that the weak 
external forcing is now able to overcome the reduced bar- 
rier and the global variable X exhibits wide oscillations 
between the two fixed points following the external forc- 
ing. If the diversity increases even further, leading to 
M > 1/3, the barrier disappears, the two fixed points 
merge at Xq = and the global variable makes small 
oscillations around this new fixed point. We then predict 
a resonance effect for intermediate values of the diversity 
for which the amplitude of the oscillations of X will be 
maximum. 

It should be clear now what the mechanism is lead- 
ing to the resonance. In the homogeneous case, when 
all systems have a, = 0, the subthreshold forcing can 
not overcome the potential barrier for any of them. As 
the diversity increases, there will be a number of units 
for which the value of aj is such that the forcing is now 
suprathreshold for them and the barrier can be overcome 
in one direction. These units are able, through the cou- 
pling term, to pull the other units and hence produce a 
collective, macroscopic, movement following the variation 
of the external forcing. For too large diversity, however, 
some of the units to be pulled offer too much resistance 
to follow the external force and this effect can not be 
overcome by the favorable units. 

Before we present the numerical results sustaining this 
diversity-induced resonance, let us present a simplified 
treatment that allows us to reproduce the aforementioned 
effect. The main problem is to obtain the variation with 
time of the second moment M{t). The classical treat- 
ment of reference ^3 consists in writing down a hierarchy 
of equations which is truncated under some Gaussian ap- 
proximations for the moments. We follow here an alter- 
native approach. We focus on the regime of slow forcings 
where we can assume that the position Xi(t) is locked at 
the absolute minimum value of the potential Vi{x{) and 
its dynamics simply follows from the movement of that 
minimum. Given X(t), this allows us to find Xi(t;ai) as 
a function of the parameter aj. Once the Xi(tYs have 
been computed in this way, the value of M(t) follows 
from its definition M(t) = J da g(a) [x(t; a) — X(t)] 
This can now be put back in eq. Q. The whole pro- 
cess can be implemented very efficiently in a numeri- 
cal integration scheme for X(t). We quantify the res- 
onance effect by the spectral amplification factor [l2| . 
i] = 4A~ 2 | (c tnt X(t)) | 2 , and (...) denotes a time aver- 
age. 

In fig. ^ we plot the amplification factor r\ versus the 
diversity <r, for different values of the period T of the 
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FIG. 1: Spectral amplification factor, rj, of the globally- 
coupled bistable model, eqs. Q. The values of the dj's are 
drawn from a Gaussian distribution of zero mean and variance 
a 2 . Some system parameters, are: N = 10 3 , C = 1, A = 0.20. 
In the main plot we observe that the amplification factor ex- 
hibits a maximum as a function of the diversity both in the 
case of a period T — 20 (black circles) and T — 10 (open 
circles) of the external forcing. The inset plots the spectral 
amplification factor as a function of the period of the forcing 
(the diversity is fixed at a = 0.55). In both plots, symbols 
correspond to numerical simulations and the lines are the cor- 
responding theoretical predictions of a simplified theory (see 
the text for details). 



external forcing for an amplitude A below the thresh- 
old value. As predicted, there is an optimum value of 
the diversity for maximum amplification, the main result 
of this Letter. Notice that our approximate treatment 
agrees rather well with the results coming from a direct 
numerical integration of the original set of equations Q , 
when the signal is slow. 

We now analyze how the system responds to different 
modulation periods of the external forcing while the am- 
plitude is kept fixed. In the inset of fig. ^ we plot the 
amplification factor as a function of the period of the ex- 
ternal forcing for fixed diversity. It can be seen that for 
large T the amplification factor reaches a constant value, 
while rj vanishes for small T. Both regimes are well de- 
scribed by the theoretical approximation. For large T 
the agreement is due to the validity of our approximate 
picture of the dynamics in that limit. For small T, the 
individual units are not able to follow the fast external 
forcing and consequently ii ~ which leads to the same 
condition to determine function of aj and X as in 

the large T limit. It is worth mentioning that the shape 
of the curve in the inset of fig. ^differs from what appears 
in stochastic resonance where a maximum at intermedi- 
ate values of T is observed 0. This difference is due to 
the absence in the diversity-induced resonance case of 
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FIG. 2: (a) Spectral amplification factor, 77, of the globally 
coupled bistable model, eqs. Q as a function of diversity 
for different values of the amplitude A of the forcing, (b) 
Dependence of r\ on the forcing amplitude for fixed values 
of diversity. Both figures use a period T — 50 and other 
parameters as in figQ Symbols represent the results coming 
from a numerical simulation of the system's equations (the 
solid line is a guide to the eye). 



a matching between two time scales which in stochastic 
resonance are the Kramer's time and the forcing period. 

In fig. [2{a), we study the effect of the amplitude of 
the forcingon the system response. As in stochastic 
resonance a maximum in the response appears only 
for subthreshold forcing and the height of this maxi- 
mum increases with decreasing amplitude. However, for 
suprathreshold forcing (the case A — 0.7) the linear 
regime is recovered and the amplification factor steadily 
decreases with increasing diversity. Fig. |2fb) shows that 
the spectral amplification factor has a maximum for a 
well defined value of the amplitude of the external forc- 
ing. 

We now turn our attention to excitable systems. As 
a paradigmatic model of interest in many biological ap- 
plications, we consider a globally coupled ensemble of 
excitable units described by the FitzHugh-Nagumo equa- 
tions: 

1 3 ^ / \ 

ex.i = Xi — — x i — yi + — y (Xj — Xi), 

iji = Xi + a,i + A sin (£1 1) . (5) 

The coupling between units is taken into account through 
the activator variable x with a coupling strength C . Each 



unit has a parameter , representing the diversity, drawn 
from a probability distribution g(a) of mean (a^) = a and 
correlations ((ai — a)(a,j~a)) = S^a 2 . When \at\ < 1 sys- 
tem i is in the oscillatory regime, while for |<Xj| > 1 it is 
in the excitable one. As in the double well case, the sys- 
tem is subjected to a periodic forcing of intensity A and 
frequency £1 and we do not consider explicit noise terms. 
The combined effect of diversity and noise was considered 
in reference in the context of coherence resonance. 
Specifically, the authors of this reference found that in 
the unforced case, A = 0, and in the presence of noise, 
there was a systematic increase of the coherence factor 
for increasing inhomogeneity. We focus in this Letter on 
the forced case, A ^ where we will show a resonance 
effect with respect to the diversity. 

The theoretical analysis follows the lines of the double- 
well system. With the definitions X = -k Y^i x i> Y 
v X« yi and M = Y,ii x i ~ x ) 2 we arrive at 

eX = X(l — M) — ^ y, 

Y = X + a + Asm(Qt) . (6) 

We conclude that in this model an increase in the di- 
versity, hence an increase in M , induces a change in the 
shape of the nullclines of the dynamics of the global vari- 
ables. As in the double well system, in the homogeneous 
case, di = a, and \a\ > 1 all units are in the excitable 
regime and we consider the case where the weak exter- 
nal forcing is not enough to overcome their excitability 
threshold. As the diversity increases, some units will have 
their excitability threshold lowered (they could even be- 
come oscillatory) and the forcing is now suprathreshold 
for them. Those units pull the others, so producing the 
observed collective behavior. The actual description of 
the collective behavior is somewhat more involved, since 
M exhibits a periodic variation with time and it has a 
maximum value when the collective variables X and Y 
are near the fixed point. In the limit of large M the null- 
clines are modified such that the limit cycle disappears 
altogether. 

In fig. E2a) we plot the amplification factor rj of the 
global X variable as a function of the diversity a for dif- 
ferent values of the external time period T and a fixed 
value of the amplitude A close to threshold, where we can 
observe the resonance effect. This plot shows some differ- 
ences with the double well system studied before, namely 
the presence of several resonances at different values of 
the diversity. We speculate that this behavior has its ori- 
gin in the existence of a well defined refractory time in 
the dynamics of an isolated unit. Several resonance max- 
ima can also be observed when plotting the amplification 
factor as a function of the period of the forcing for fixed 
diversity, see fig. EJb). A similar effect has been also 
reported for a single FitzHugh-Nagumo system in the 
presence of noise and it is known as frequency-dependent 
stochastic resonance [l4| . 

In conclusion, we have given evidence that diversity, in 
the form of quenched noise, can enhance and lead to a 



4 



0-0 3"= 1.6 

T=5.0 



311(1 



20(1 




0.05 0.1 0.2 



400 



100 





(b) 






O-O 0=0.08 






•-•(7 = 0.49 









FIG. 3: Spectral amplification factor, rj, of the globally- 
coupled FitzHugh-Nagumo model, eqs. ©, where the at's 
have been drawn from a Gaussian distribution of mean a 
and variance a 2 . Some system parameters, are: N = 10 3 , 
e = 1CT 2 , a = 1.12, C = 1, A = 0.05. (a) Plot of rj as a 
function of the diversity a for different periods of the exter- 
nal forcing, (b) Plot of 77 as a function of the period T for 
different values of the diversity a. In both cases the symbols 
represent the results coming from a numerical simulation of 
the system's equations (the solid line is a guide to the eye). 



resonant effect for the response of an extended system to 
an external periodic forcing. The evidence has been given 
for two prototype systems, paradigmatic of bistable and 
excitable behavior and, hence, we believe that the same 



resonance will appear in other more complicated systems. 
The mechanism of the phenomenon is particularly sim- 
ple: at a given time a fraction of the units are able to 
respond to the external forcing; those units, through the 
coupling terms, are able to pull the others into the direc- 
tion of the force. For too large diversity, the favorable 
units can not overcome the effect of the adverse ones. 
This resonance mechanism is very general and it could 
appear in many fields. 

A final remark is relevant here. Note that in equation 
Q for the global variable X the effect of the diversity 
appears only through the variable M measuring the dis- 
persion in the behavior of the dynamics of the individual 
units Xi. Therefore, the existence of a resonance effect 
for the optimal amplification of weak signals does not de- 
pend on the source of the disorder. The same effect could 
also be obtained in the presence of disorder induced by 
noise (stochastic resonance) , by a non-regular network of 
connectivities, inhibitory couplings, etc. 

The idea that different sources of diversity can produce 
a resonant effect leads us to speculate that the amount 
of diversity present in some biological systems has an im- 
portant function. Diversity could have been evolutionary 
tuned in order to enhance the detection of weak signals. 
Whether natural systems have taken advantage or not 
from this diversity related effect is a question that, as in 
the particular case of stochastic resonance, has not yet a 
clear answer. 
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